Two cases requiring external reinforcement in perceptual learning.

نویسندگان

  • Aaron R Seitz
  • Jose E Nanez
  • Steve Holloway
  • Yoshiaki Tsushima
  • Takeo Watanabe
چکیده

The role of external reinforcement is an issue of much debate and uncertainty in perceptual learning research. Although it is commonly acknowledged that external reinforcement, such as performance feedback, can aid in perceptual learning (M. H. Herzog & M. Fahle, 1997), there are many examples in which it is not required (K. Ball & R. Sekuler, 1987; M. Fahle, S. Edelman, & T. Poggio, 1995; A. Karni & D. Sagi, 1991; S. P. McKee & G. Westheimer, 1978; L. P. Shiu & H. Pashler, 1992). Additionally, learning without external reinforcement can occur even for stimuli that are irrelevant to the subject's task (A. R. Seitz & T. Watanabe, 2003). It has been thus hypothesized that internal reinforcement can serve a similar role as external reinforcement in learning (M. H. Herzog & M. Fahle, 1998; A. Seitz & T. Watanabe, 2005). This idea suggests that perceptual learning should occur in the absence of external reinforcement provided that easy exemplars are utilized as a basis for the subject to generate internal reinforcement. Here, we report results from two studies that show that this is not always the case. In the first study, subjects participated in two sessions of a motion direction discrimination task with low-contrast dots moving in directions separated by 90 degrees. In the second study, subjects participated in 12 orientation-discrimination sessions using oriented bars (oriented either 70 degrees or 110 degrees) that were masked by spatial noise. Trials of different signal levels (yielding psychometric functions ranging from chance to ceiling) were randomly interleaved. In both studies, subjects experiencing external reinforcement showed significant learning, whereas subjects receiving no external reinforcement failed to show learning. We conclude that while internal reinforcement is an important learning signal, the presence of easy exemplars is not sufficient to generate reinforcement signals.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Are People Successful at Learning Sequences of Actions on a Perceptual Matching Task?

We report the results of an experiment in which human subjects were trained to perform a perceptual matching task. Subjects were asked to manipulate comparison objects until they matched target objects using the fewest manipulations possible. An unusual feature of the experimental task is that efficient performance requires an understanding of the hidden or latent causal structure governing the...

متن کامل

Mesolimbic confidence signals guide perceptual learning in the absence of external feedback

It is well established that learning can occur without external feedback, yet normative reinforcement learning theories have difficulties explaining such instances of learning. Here, we propose that human observers are capable of generating their own feedback signals by monitoring internal decision variables. We investigated this hypothesis in a visual perceptual learning task using fMRI and co...

متن کامل

A Biologically Inspired Method for Conceptual Imitation Using Reinforcement Learning

Levels Observations are categorized to concepts with respect to some principles that depend on physical and=or functional characteristics of the items. From this perspective, Zentall et al. have categorized concepts to three levels of abstraction (Zentall et al. 2002) (see Figure 1): Perceptual: These concepts are formed solely by measuring similarity of instances in perceptual space. Such data...

متن کامل

Self-Organizing Perceptual and Temporal Abstraction for Robot Reinforcement Learning

A major current challenge in reinforcement learning research is to extend methods that work well on discrete, short-range, low-dimensional problems to continuous, highdiameter, high-dimensional problems, such as robot navigation using high-resolution sensors. We present a method whereby an robot in a continuous world can, with little prior knowledge of its sensorimotor system, environment, and ...

متن کامل

Low-Area/Low-Power CMOS Op-Amps Design Based on Total Optimality Index Using Reinforcement Learning Approach

This paper presents the application of reinforcement learning in automatic analog IC design. In this work, the Multi-Objective approach by Learning Automata is evaluated for accommodating required functionalities and performance specifications considering optimal minimizing of MOSFETs area and power consumption for two famous CMOS op-amps. The results show the ability of the proposed method to ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Journal of vision

دوره 6 9  شماره 

صفحات  -

تاریخ انتشار 2006